Sakana AI Launches Transformer²: A Breakthrough Technology for Language Model Adaptability

Japanese artificial intelligence company Sakana AI recently launched Transformer², an innovative approach designed to help language models adapt more efficiently to various tasks. Unlike existing AI systems, Transformer² addresses the limitations faced by language models when encountering new tasks through a two-stage learning process, marking a significant advancement in the field of continual learning technology. Current AI systems often require processing multiple tasks in a single training run, but they struggle when faced with new tasks.